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Abstract — The necessary and sufficient condition of the chan- 
nel capacity is rigorously formulated for the iV-user discrete 
memoryless multiple-access channel (MAC). The essence of the 
formulation is to invoke an elementary MAC where sizes of input 
alphabets are not greater than the size of output alphabet. The 
main objective is to demonstrate that the channel capacity of 
an MAC is achieved by an elementary MAC included in the 
original MAC. The proof is quite straightforward by the very 
definition of the elementary MAC. Moreover it is proved that 
the Kuhn-Tucker conditions of the elementary MAC are strictly 
sufficient and obviously necessary for the channel capacity. The 
latter proof requires some steps such that for the elementary 
MAC every solution of the Kuhn-Tucker conditions reveals itself 
as local maximum on the domain of all possible input probability 
distributions and then it achieves the channel capacity. As a 
result, in respect of the channel capacity, the MAC in general 
can be regarded as an aggregate of a finite number of elementary 
MAC'S. 

Index Terms — multiple-access channel (MAC), elementary 
MAC, master elementary set, channel capacity, Kuhn-Tucker 
conditions, capacity region, boundary equation 



I. Introduction 

THE channel capacity is without question recognized as an 
essential subject of the (discrete memoryless) multiple- 
access channel (MAC) with N input-terminals and one output- 
terminal. Since it is defined as the maximum of the mutual 
information, we are familiar with the so-called Kuhn-Tucker 
conditions as necessary to achieve the channel capacity. Up 
to now, however, the Kuhn-Tucker conditions are not entirely 
examined as sufficient for the iV-user MAC except for the 
simplest case of single user discrete memoryless channel 
(DMC). Thus it is natural to ask how the sufficiency could 
be formulated for the case of MAC in general. 

In this paper, we demonstrate that there exists a non-trivial 
MAC where the Kuhn-Tucker conditions are strictly sufficient 
(and obviously necessary) for the channel capacity. We refer 
to it as an elementary MAC whose sizes of input alphabets 
are not greater than the size of output alphabet. Evidently the 
DMC is an elementary MAC. The most of this paper is devoted 
to the proof that the Kuhn-Tucker conditions are sufficient 
(the necessity is self-evident) for the channel capacity of the 
elementary MAC. 

On the other hand, for any given iV-user MAC we can 
uniquely determine a finite set of elementary MAC's. It is an 
aggregate of the largest possible elementary MAC's included 
in the given iV-user MAC and is referred to as the master 
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elementary set to be denoted by fi^r. We demonstrate that 
the channel capacity of the iV-user MAC is achieved by the 
channel capacity of an elementary MAC of the set Qn- The 
proof here appears quite straightforward by merely appealing 
to the very definition of the elementary MAC without asking 
for any other features such that the Kuhn-Tucker conditions 
are sufficient. 

Thus an MAC in general can be regarded as simply an 
aggregate of elementary MAC's where the Kuhn-Tucker con- 
ditions are necessary and sufficient for the channel capacity. 
Roughly speaking, an MAC comprises a finite number of 
elementary MAC's. This statement is a basic idea behind our 
formulation of this paper. 

Here we must emphasize that several steps are required to 
prove the sufficiency of the Kuhn-Tucker conditions of the 
elementary MAC. In fact, we need to prove two distinctive 
features: The first is that for the elementary MAC every 
solution of the Kuhn-Tucker conditions is local maximum on 
the domain of all possible input probability distribution (IPD) 
(or the probability simplex, see Cover [1] for this terminology 
and we refer to them as IPD vectors for our purposes). The 
second is that for the elementary MAC a set of IPD vectors 
for which the value of the mutual information is not smaller 
than the arbitrary positive number is connected on the domain 
of all possible IPD vectors. To prove the second property of 
connectedness we require the first property of local maximum. 
Then it follows after a bit of procedures that solutions of the 
Kuhn-Tucker conditions are uniquely determined, that is, each 
solution takes the same value for the mutual information and 
therefore it achieves the channel capacity. 

For the explicit description of our concept we take a logical 
stream as follows: After defining the elementary MAC and 
determining the set fi^r, we first prove as the main theorem 
that the channel capacity of an TV-user MAC is achieved by the 
channel capacity of an elementary MAC of Q,n and then we 
prove as the second theorem that the Kuhn-Tucker conditions 
are sufficient for the channel capacity of the elementary MAC. 
These are the main objective of this paper. 

After Shannon [2], the study of multiuser channel (multi- 
terminal network) has long been carried out in various fields 
including MAC, broadcast channel, relay channel, interference 
channel, two-way channel and so forth. The channel coding 
theorem was proved independently by Liao [3], Ahlswede [4] 
and Meulen [5]. These are followed by many authors ([6], 
[7], [8], [9], [10], [11], [12]) to provide a deeper insight into 
the capacity region. Recently, information-theoretic approach 
has been adopted to large scale networks, such that code 
division multiple-access channel, continuous time multiple- 
access channel and space-time multiple-access channel (e.g., 



2 



[13], [14], [15], [16], [17]), as we know. Also a computation 
procedure for the channel capacity of MAC has been devel- 
oped (e.g., [18]). 

The purpose of the study of MAC is mostly to inves- 
tigate the multiuser coding that retains both reliability and 
efficiency. The investigation has been carried out mostly on 
the computational calculations for practical applications. Not 
much has been made for the mathematical rigorousness of the 
formulation since it appears rather hard to solve a non-linear 
optimization problem of the mutual information with several 
variables under constraints. We have been highly expecting a 
theoretical foundation, in particular, for the rigorous evaluation 
of the channel capacity and the exact determination of the 
capacity region for the MAC in general. These can provide us 
with the mathematical essence as well as the fine structure 
inherent in the MAC. Also we believe that these can in 
part complement the computational approaches to various 
applications as well. 

In the past, for the MAC of two-user and binary output [19], 
we have shown that the Kuhn-Tucker conditions are necessary 
and sufficient for the channel capacity. The basic idea was to 
identify the channel matrix of the MAC as a linear mapping 
from the convex-closure of IPD vectors to the range of output 
probability distributions. Now we expand the idea and remind 
a clear conception to describe the MAC as a pair of channel 
matrix P and domain X where X is a set of IPD vectors and 
P is interpreted as a mapping (non-linear in general) from IPD 
vectors to output probability distributions. Any quantity such 
as mutual information and so forth is considered as a function 
of IPD vectors defined on a restricted domain (a sub-set) of X. 
These are seemingly non-standard in contrast to the ordinary 
description of information theory as in [1]. However, we 
assure ourselves that these conceptions including the notation 
adopted in this paper are so successful to overcome some 
difficulties and cumbersome procedures underlying in the non- 
linear optimization problem relating to the mutual information 
of the MAC. 

In Section [II] we describe some expressions and defini- 
tions to be used in this paper. In particular we introduce 
an elementary MAC and the master elementary set for the 
MAC. In Section [III] we prove the main theorem of this 
paper as Theorem Q] followed by indicating the value of this 
theorem. In Section [IV] we investigate distinctive features of 
the elementary MAC that are required to prove the succeeding 
Theorem [2] In Section [V] we investigate an special case of 
binary-inputs MAC. In Section[VT]we prove Theorem[2] In the 
last Section [VHl we summarize the paper with some comments. 

II. Elementary MAC 

In this section we introduce an elementary MAC with some 
expressions and definitions to be used in this paper. 

An N-user MAC is specified by N input alphabets A k 
with size of n k , k = 1,---,N, an output alphabet B 
with size of m, and an m by (n x x ••• x un) chan- 
nel matrix P = [P{j in)] of transmission prob- 
abilities P(j\ix, ■ ■ • , ij\r)'s to be given a priori for the 
MAC, where j=0, • • • , m — 1, i k =0, • • • , rife — 1, and Y^^o 



P(j\ii, ■ ■ ■ ,«at) = 1. Assume that there is no zero row in 
P, n k > 2, m > 2, and transmission is synchronized. The 
model thus defined is called an Abuser MAC with a type 
(ni,---,n N ;m). 

The IPD vector p k is assigned to an n^-tuple column set 
of input probability (p k (0), ■ ■ ■ ,p k (n k - 1)) T , k = 1, - ■ ■ ,N, 
where (• • ) T implies a transposition, defined on A k with the 
probability constraint Yl7 k =o Pk{ik) = !■ Thus each p k is 
located on an (rife — 1) -dimensional simplex X k with n k 
vertices ey, £ = 0, ■ • • , n& — 1. Here e k e is a unit column 
vector and takes 1 in the £th column component and 
elsewhere. Obviously each X k is convex and is observed as a 
domain of p k . 

The face F k of X k is defined by an (f k — 1)- 
dimensional simplex whose f k vertices are chosen from ver- 
tices e k0 , ■■■ , e fc ( nfc _!) of X k , where f k < n k . A set of f k 
indices of F k is denoted by A(F k ) = {£\e k g G F k }. There 
are several choices for f k indices. Obviously A(F k ) C A(X k ) 
and A(X k ) — {0,---,n k — 1}. Zero-dimensional faces are 
vertices, one-dimensional faces are lines, and so forth. If an 
IPD vector p k is on the boundary of X k , then there exists 
a minimum face F k which contains p k exactly inside (and 
not on the boundary of) F k . Thus if p k is p k (i k ) = for 
i k £ A(F fe ) and p k (i k ) > for i k G A(F k ), then F k for 
A(F k ) is the minimum face which contains p k and is uniquely 
determined. If p k (i k ) > for all i k 's, then the minimum face 
which contains the p k is X k itself. Here F k is also referred 
to as a sub-domain of X k . Also p k , with p k (i k ) > for 
i k G A(F k ) and p k (i k ) = for i k £ A(F k ), is naturally 
regarded as an (fk — 1) -dimensional vector on F k even it is 
still an (n k — l)-dimensional vector on the whole domain X k . 

The Kronecker product of p 1 and p 2 is defined here by 



Pi x p 2 



Pi(0)p 2 
pi(ni - l)p 2 



and then the Kronecker product of p 1 , ■ ■ ■ , p k is defined by 
induction: p x x • • • X p k = (p x X • • • X p k _ x ) x p k , k = 
3, • • • , N. In the same way we arrange the Kronecker product 

of X\ , • • • , Xn as 



X = Xi x 



x X 



N- 



The set X is a domain of the IPD vector p = p x x • • • x p N 
of the Abuser MAC. Remark that X is not convex as a whole 
but each X k is convex. Also we can set a Kronecker product 
of faces Fx, ■ ■ ■ , Fn as F = F x x • • ■ x Fn which is a sub- 
domain of X. Obviously F is not convex as a whole even 
each F k is convex. 

A pair (P, X) is assigned to the A-user MAC to specify 
a channel matrix P and a domain X. Here P has columns 
(P(0|ii, • • • , iff), ■ ■ ■ , P(m — l\ix, • • • , in)) 1 arranged in the 
order of the components of p x X • • ■ xp N . An MAC is denoted 
in more detail by A-user (nx, • ■ ■ , un\ m)-MAC (P, X). 
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The mutual information of the TV-user (m, • • • , n/v; tn)- 
MAC (P, X) is denned by 



I(Pi x ■ ' ' x Pn) 

P(j\h, •••,«» 



log ; 



9(3) 

...,i N Pi(h)---PT(iN)P(j\k,- 



(1) 



where g(j) = J2i u -,i N Pi^i) ' ' -PT(iN)P(j\ii, • • • , in) is 
an output probability of the jth symbol of B and log is the 
natural logarithm. For any p',p" G A, a convex-linear com- 
bination Xp' + (1 — A)p", < A < 1, does not always belong 
to X, since X is not convex except N = 1. Therefore, P is 
considered in general as a non-linear mapping from pel 
to q = (g(0), • • • , q(m - 1)) T : q = Pp = P{p 1 x • • • x p N ). 
Also /(pj x • • • xp^y) is regarded as a multi-variables function 
defined on the domain X = X\ x • ■ ■ x X^ and is concave 
(convex-above) on each X k , when p/s, I ^ k, are fixed, but 
is not concave on the whole domain X. 

The channel capacity of the Abuser (rii, • • • ,tin; to)-MAC 
(P, X) is defined as usual by the maximum value of the mutual 
information (Q]): 



C 



max P\P\ x 

p 1 x-xp N £X 



*Pn) 



(2) 



An IPD vector which achieves the channel capacity is referred 
to as an optimal IPD vector. 

The Kuhn-Tucker conditions are introduced as the conditions 
to obtain the local extrema of a function of several variables 
subject to one or more constraints. For the mutual information 
© of the A-user (m, • • • , n N ; m)-MAC (P, X), the condi- 
tions to take the maximum value (channel capacity) are stated 
as follows: If p x x • • • x p N is optimal, then it satisfies 

= C, p k (i k ) > 
<C, p k (i k ) = Q 
i k = 0, • ■ • , n k - 1, k — 1, • ■ • , A 
C = /(pi x---xp N ) 

where 

91{px x • • • x p N ) 



J(Pi x ■ • • x p N ;i k ) 



(3) 



J(Pi x ■ • • x p N ;i k ) 



dp k {h 



+ 1 



Pi(ii) • ■ ■ Pk-i(ik-i)Pk+i(h+i) 



•PN{iN)P{j\h, ■ ■ • ,i/v)lo{ 



These equations (f3]i are collectively referred to as the Kuhn- 
Tucker conditions for the mutual information ((T). These are 
quite easy to obtain, for example, by a method of Lagrange 
multipliers to maximize the mutual information (HJ subject 
to the constraints of p k : Yn k =o Pk{ik) = 1, fc = 1, • • • , A. 
Remark that the Kuhn-Tucker conditions (01 are obviously 
necessary but not in general sufficient for the channel capacity 
of the MAC (P,X). In the case of DMC, however, they are 
necessary and sufficient for the channel capacity [20]. 

A sub-MAC (P, Y), or a sub-channel, of an A-user 
(ni, • • ■ , Tijvi m)-MAC (P, X) is reasonably defined as an Ab- 
user MAC where the channel matrix is set to the same P 



and the domain is assigned to a non-empty subset Y of X. 
In the subsequent discussions we focus mostly on the sub- 
MAC (P, Y) where Y is restricted to a sub-domain F = 
Fx x • • • x Fn C X k . Here if p is an IPD vector of the 
sub-MAC (P, F), then each p k of p acts as an (f k — 1)- 
dimensional vector on F k (i.e., p k (i k ) — for i k $ A(F k )) 
even it is still an (n k — 1) -dimensional vector on the whole 
domain X k as mentioned before. The mutual information of 
an A-user sub-MAC (P, F) is given by I(p G F) where 
the (ii, ■ ■ ■ , i k , ■ ■ ■ , iAr)th columns of P for i k g" A(F k ) 
do not affect the mutual information (fl}. The Kuhn-Tucker 
conditions for an A-user sub-MAC (P, F) are also given by 
the expression (O where p G P. 

The elementary MAC now we define in general as follows: 
If A-user (m, ■ • • , Un', m)-MAC (P, X) satisfies n k < rn 
for all k — 1, • • • , A, then it is referred to as an elementary 
MAC. The elementary MAC is an MAC whose sizes of input 
alphabets are not greater than the size of output alphabet. 

The elementary (face) set of X is defined by the set 
of faces as follows: If n k > m, then F k is put to an (m — 1)- 
dimensional face of X k , and if n k < m, then F k is put to the 
(n k — 1) -dimensional X k itself. Thus the dimension of each 
Pfc is less than or equal to (m — 1). If X is formed by n k < m 
for all k = 1, • • • , A, then = {X}. 

A master (elementary) MAC (P, F) of an A-user MAC 
(P, X) is defined as the MAC with a domain P G $^' ) . 
Here each p k G F k acts as an (f k — 1) -dimensional vector 
as mentioned above, where p k (i k ) = for i k g" A(F k ), 
k = 1,---,A. Note that the master MAC (P, F G 
is regarded as f/ze largest possible elementary MAC of (P, A) 
in the sense that there is no elementary MAC (P, F') such 
that (P, P) is an elementary sub-MAC of (P, P'). A set of all 
master MAC's is referred to as the master (elementary) set of 
the A-user MAC (P, X) and is denoted by Q, N . Obviously 
£In is finite and is uniquely determined. If an MAC (P,X) 
is itself elementary, then J7jy = {MAC(P,A)}. The channel 
capacity of an MAC (P,P) G SI at is denoted by C(F). 

In later discussions we investigate the IPD vector p which 
satisfies the Kuhn-Tucker conditions OJ. If p k (i k ) > for all 
i k = 0, ■ • • , rifc — 1, k = 1, • ■ • , N, then p is located exactly 
inside (not on the boundary of) X. If p k (i k ) — for i k ^ 
A(P fc ) and p k (i k ) > for i k G A(P fc ), k = 1, • • • , A, then 
the sub-domain F = F\ x • • • x Pjy of X formed by A(F k ) 
is the minimum domain which contains p exactly inside P. 

More importantly, the non-elementary MAC has in essence 
a degenerate property as follows: if n k > m for an A-user 
(ni, ■ • • , njv; m)-MAC, then for a fixed p k G Fk C A& with 
/fc > m, there exists an IPD vector p' k G F k where p 1 ^ p, 
F' k G (^)Pfc, /fe = m, and p = p t x • • • x p k x • • • x p N , 
p' = Pi x ■ • • x p' k x • • • x p w , such that q = Pp' = Pp. The 
elementary MAC has in general no such property. This notion 
is crucial to the subsequent discussions. 

Finally for this section, we remark that we are going to 
investigate various types of MAC's. For example, we examine 
an MAC (P, Y) with a domain Y = Y\ x • • • x Y N C X where 
each Y k , k = 1, • • • N, is formed by the line segment of IPD 
vectors of X k . Even then we can examine the Kuhn-Tucker 
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conditions in the same way as mentioned above. 

III. Main Result 

The master elementary set il^ as defined above has an 
intrinsic property with respect to the TV-user (m, • ■ • , njv; m)- 
MAC (P, X). We can state it as a main theorem: 

Theorem 1: The channel capacity C of an TV-user 
(ni, ■ • • , riN', m)-MAC (P,X) is achieved by the channel 
capacity C(F) of an TV-user elementary MAC (P, F e $^ } ) 
of fijv as follows: 

C= max C{F). (4) 

□ 

Proof: It is sufficient to prove the case that the original 
MAC (P, X) is not elementary. Let p =p 1 x - ■ ■ xp k x • • • xpjy 
be an optimal IPD vector that achieves the channel capacity 
C. Let F k be the minimum face of Xk which contains p k 
exactly inside Fk, k = 1, • • • TV. It is sufficient to assume that 
Fk is the m or more dimensional face. Then by the degenerate 
property there exists an (m— 1) -dimensional face Fk C (^)Ffc 
such that for an IPD vector p k eft, 

Pp = P(p 1 x ■■■ xp k x ••• xp N ). (5) 

Put 

K{9) = I{p x x ... x (9p k + (1 - 9)p k ) x---xp N ) 

for the mutual information of the original MAC (P,X), where 
< 9 < 1. The derivative 8K(9)/d9 is constant by © and 
moreover 8K(9)/d9 is equal to zero since p is optimal. Then 
it holds 

I(p) = I(p 1 x ••• xp k x ■•■ xp^). 

This implies that the optimal IPD vector exists in a domain 
F = F x x ■ ■ ■ x F k x ■ ■ ■ x F N e ^\ Thus Theorem Q] is 
proved. ■ 

Theorem Q] states that the channel capacity C of any TV-user 
(ni, ■ ■ ■ , tin; m)-MAC (P, X) is rigorously determined by the 
channel capacity C(F) of an TV-user master elementary MAC 
(P, F) £ f2jv- In other words, an optimal IPD vector exists at 
least on a domain F £ ■ However Theorem Q] does not 
guarantee that the optimal IPD vector exists only on a domain 
F £ that is, there might exist in general an optimal IPD 

vector that is located exactly inside X and not on any F £ 
Note that if the TV-user (m, ■ ■ ■ , n N ; m)-MAC (P, X) 
is elementary, then Theorem Q] appears self-evident since fi^r 
contains only an MAC (P, X) itself. 

In the remaining section of this paper we focus on the 
proof that the Kuhn-Tucker conditions of an elementary MAC 
(P, X) are necessary and sufficient for the channel capacity. 
We will state it in advance as a second theorem. 

Theorem 2: The Kuhn-Tucker conditions for the channel 
capacity C of an TV-user elementary (n x , ■ ■ ■ , n^; m)-MAC 
(P, X), where n k < m for all k = 1, • • • , TV, are necessary 
and sufficient. □ 

It is sufficient to prove only the sufficiency since the 
necessity is self-evident. From these two theorems the MAC 



in general can be regarded as simply an aggregate of a finite 
number of elementary MAC's where the Kuhn-Tucker condi- 
tions for the channel capacity are necessary and sufficient. 

IV. Features of Elementary MAC 

In this section we prepare basic properties that are required 
to prove the sufficiency of Theorem [2] 

The first property A is the chain rules [1]: We recall that the 
mutual information of an TV-user MAC is in general decom- 
posed into TV components with TV! different decompositions 
by the chain rules. 

The second property B is the capacity region: We describe 
that the capacity region of the TV-user MAC is given by the 
convex-closure of all achievable rate regions of the TV! decom- 
positions for the mutual information [4]. It is summarized as 
Proposition Q] 

The third property C is the boundary equations: We inves- 
tigate that a boundary of an achievable rate region satisfies 
by a method of Lagrange multipliers a set of conditions to be 
referred to as the boundary equations for the capacity region 
of the TV-user MAC. 

The fourth property D is a relation between the Kuhn- 
Tucker equations and the boundary equations: We prove as 
Proposition H] that a solution of the Kuhn-Tucker conditions of 
an TV-user MAC with some restrictions satisfies the boundary 
equations. 

The fifth property E is local maximum: We prove as Propo- 
sition |3] that every solution of the Kuhn-Tucker conditions of 
an elementary MAC (P, X) is local maximum in the domain 
X. To prove Proposition [3] we need Proposition [2] 

Finally, the sixth property F is connectedness: We prove as 
Proposition |4] that a set of IPD vectors of an elementary MAC 
(P, X), for which the value of the mutual information is not 
smaller than the arbitrary positive number, is connected in the 
domain X. To prove Proposition [4] we use Proposition [3] 

We emphasize here that the last two properties, i.e. local 
maximum and connectedness, are the most distinctive features 
exclusive to the elementary MAC. However the first four 
properties, although they hold for any MAC in general, are 
required to step by step prove the last two. 



A. Chain Rules 

The mutual information of an TV-user (n\, ■ ■ ■ , tin', m)- 
MAC (P, X) is decomposed into TV components by the chain 
rules [1]. For the IPD vectors p x , • • • , p k _ x , p k , p k+1 , ■ ■ ■ ,p N , 
let p^ u ... w y be a Kronecker product of p k , k ^ {u, ■ ■ ■ , w}, 
and let cri Ut ... iW \ be a Kronecker product of p k , k £ 
{u, ■ ■ ■ , w}. Obviously <T{ U } = P u - 

The mutual information (Q} is decomposed into two com- 
ponents as 

I(Pi x • • • x Pn) = 

I ( (T {u}\P{u}) + I (P{u}/ (T {u})- 
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Here 



I ( (7 {u}\P{u}) = 

E P 1 ^ 1 ) • ' -PN(iN)P(j\ii,- ■ ■ Jn) 



•log 



P(j\h,---,iN) 



Y,hPu{h)P{j\h, ■ ■ ■ , h, ■ ■ ■ , i N ) 



which is the conditional mutual information of p u with respect 
toPi,---»P«-i>P»+f->Pjv. and 

I (P{u}/ (7 {u}) = 

^ Px(h)---PN(iN)P(j\ii,---,iN) 
T,hPu(h)P(j\ii,- ■ ■ ,h,- ■ ■ ,i N ) 



•log- 



which is the mutual information of an (A — l)-user MAC 
with the channel matrix \}2 h Pu{h)P{j\ii, ■ ■ ■ , h, ■ ■ ■ , zjv)]. 
Moreover we decompose the latter into 

I (P{u}/ Cr {u}) = 

I (P w \P{u,w}/ cr {u}) + P\P{u,w}/ cr {u,w})- 



In general, 



Here 



I(.P{u,---,iu}/ (T {u,--,w}) = 

I (Px\P{u,---,x,--,w}/ (T {u, ...,«)}) 
+I(P{u,---,x,---,w}/ (T {u,---,x---,w})- 



HPx\P{u,-,x,-,w}/ (T {u,---,w}) - 

53 Pi(h)---pr(iN)P(j\ii,---,iN) 



•log 



{<7{u,-,w} • P) 
(f {u,---.x,---.w} ■ P) 



I(P{u,---,x,---,w}/ (T {u,---,x---,w}) — 

^2 Pi(ii) ■ ■ -PN(iN)P(j\ii,- ■ ■ Jn) 



{u,- ■ ■ ,X ■ ■ ,W 



•log- 



where 



(o-{u,-,w} ■ P) = X! Pu{h u ) ■ ■ ■ Pw{h w ) 
•P(j\h,' ■ ■ , h u , ■ ■ ■ , h w , ■ ■ ■ , in)- 

If {u,---,w} is empty, then (tr/ U) ... itI) } • P) reduces to 
P(j | z i , • • • , in)- Thus successively reducing the suffices 
{u,---,w} of p {tl; ... !lt)} up to {1, • • • , k - 1, k + 1, • • • , iV}, 
I(Pi x • • • x pjy) is decomposed into N components. Note 
that there exist as a whole AH different decompositions. 



B. Capacity Region 

A set of all achievable rates for an A-user (m, • ■ • , tt-jv; m)- 
MAC (P,X) is called a capacity region (e.g., [1], [3], [4]). 
By a decomposition we obtain 

I(Pi x ■•• ><Pn) = 

P\Px \Pi x ' ' ' x Pn) + P\Pi IPs x ' ' ' x Pn/Px) 
+I(Pa\P4 x • • • x pjv/Pi x p 2 ) + ■ ■ ■ 

■■■ + HPn/Pi x ••• xPjv-i)- ( 6 ) 

There exist as a whole A! different decompositions as men- 
tioned above. Define a sub-region G\ as 

U (HPi\P2 x ••• XPn),---J(Pn/Pi x ••• xp*r_i)). 

This is identified as a set of achievable rates G\ for the 
decomposition d6]l. Other A! — 1 sets of achievable rates G2, 
■ ■ Gjvi are also defined in the same way as G\. Then the 
capacity region G is determined by those sub-regions Gi's as 
follows [Theorem 15.3.6 in [1]]: 

Proposition 1: The capacity region of an A-user 
(ni, • • • , tin] m)-MAC (P, X) is given by 



m 



G 



where "co" implies the convex-closure. 



(7) 



□ 



C. Boundary Equations 

A boundary of each sub-region Gi, i = 1, • • • , A!, for an 
A-user (m, • • • , n^; m)-MAC (P, X), can be determined by 
a method of Lagrange multipliers. The boundary of G\, for 
example, is evaluated by a Lagrange multiplier function, 

L{Pi, • ■ ■ ,Pn, Ai, • • • , Ajv_i,Ci, • • • , Cat) = 
I(Pi\p 2 x ••• x Pat) 

-Xll^ X ••■ X Pn ) 

-A 2 /(p 2 |P3 x • • • x p N /pi) 

-\ N - 1 I{p N _ 1 \p N /p 1 X ■ • • x p N _ 2 ) 



N 

E 

k=l 



Ck^2pk(ik) 



where Ai, • • • , Ajy_i and Ci> ' " ' > Civ are so-called Lagrange 
multipliers. The conditions that an IPD vector p x X • • • X p N 
takes extremum (maximum or minimum) for G\ are given by 
the equations (see Fig. [TJfor A = 3) 

9I(Pi |p 2 x • • • x p N ) dl{p 1 x • • • x p N ) 



det 



dpi(h) dpi(ii) 
dPyPi IP2 x • • • x p N ) dl{p 1 x • • • x p N ) 



dpN{iN) 
9I{P 2 \P3 x 



dpN(iw) 



x Pn/Pi) 



dpi(h) 



9I(p 2 \P3 



X Pjv/Pl) 



9pjv(«Af) 
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I(P2\pJPl) = "2 




I(Pi\P2 x Pa) 
cross-sec, tion 

R2 



Fig. 1. Sub-region G\ of three-user MAC. 



d!{p N -i\PN/Pi x ■ ■ ■ x p w _ 2 ) 



9I(Pn-i\PnIPi 



PN-2> 



0, i fc = 0, 



Qpn^n) 
■,nk—2,k 



,JV. 



(8) 



Here, we define partial derivatives as: 

§!(■■■) _ di(---) di(---: 



-,ik ¥= n k - 1- 



dpk(ik) dPk(ik) dp k {n k -l)' 

Total (ni — 1) x ■ • • x (njv — 1) equations (JHJ are collectively 
referred to as the boundary equations for G\. Solutions of ((8) 
include both maximization and minimization as usual. Succes- 
sively we can set up the boundary equations for G2 , • • • , Gn< 
with totally the same form as ([8]). Note that the boundary 
equations have the same form as ([8]) for the different choices 
of starting Lagrange multiplier function. 

D. A relation between the Kuhn-Tucker equations and the 
boundary equations 

The boundary equations thus obtained have an important 
property which we state as a proposition: 

Proposition 2: If a solution p — p l x • • ■ x p N g X of 
the Kuhn-Tucker conditions for the mutual information I(p) 
of an TV-user (n 1; ■ ■ ■ ,n^; m)-MAC (P, X) satisfies 

J(Pi x ' ' ' x p N \i k ) = C, 

i k = 0,---,n k -l,k=l,---,N 

C = I{p 1 x • • • x p N ) (9) 

then p is a solution of the boundary equations for sub-regions 
Gi,i = l,--.,NL ' □ 

Proof: It is sufficient to prove that p satisfies the boundary 
equation ([8]) for G\. By the assumption (O, it holds 



dI{Pi x • • • x p N ) 



dpk{ik) 

J(Pi x ■• 
= 0. 



Pfc=Pfc,«fc=0,---,n fc -2 

x P N ]ik) - J(pi x ■ • • x p N ;n k - 1) 



Then the second column of © reduces to zeros. Therefore p 
is a solution of the boundary equation ((H). ■ 
Remark that Proposition |2] holds for any MAC including the 
elementary MAC if it satisfies the conditions (|9). 



E. Local Maximum 

An IPD vector p is called a local maximum point for the 
mutual information I(p), if there exists a neighborhood Up of 
p such that I(p) < I(p) for any p £ Up. We prove here that 
for the elementary MAC every solution of the Kuhn-Tucker 
conditions is local maximum. We state it as a proposition: 

Proposition 3: If an iV-user (71 1, • ■ • , n^; m)-MAC (P, X) 
is elementary, i.e. n k < m, k = 1, • • • , N, then every solution 
p* = pl x ■ ■ • x p* N elof the Kuhn-Tucker conditions for 
the mutual information I(p) is local maximum in X. □ 

Before proceeding we remark that Proposition O does not 
hold in general for the non-elementary MAC by the degenerate 
property as is stated in the beginning of the proof of Theo- 
rem [T] In fact, we note without proof that a non-elementary 
two-user (3, 3; 2)-MAC (P, X), for example, with N = 2, 
n\ = ri2 = 3, m = 2, for some channel matrix P, has 
a solution of the Kuhn-Tucker conditions which is not local 
maximum in X. 

Proof: Since the iV-user MAC (P, X) is elementary, it 
is sufficient to investigate two cases for the solution p* of 
the Kuhn-Tucker conditions: the first is that every p k (ik) is 
non-zero and the second is that at least one of p%(ik)'s is zero. 

In the first case, since p k (ik) > for all components, p* 
satisfies the Kuhn-Tucker conditions: 

J{p\ x • • • X p* N ]ik) = M T 

pt(ik) > 0, i k = 0, • • -,nk - 1, k = l,---,N 
M T = I(p{x---xp* N ). (10) 

and there exist p' and p" in X such that 

P * = {eip'[ + (1 - et) P [) x ••• x (9* nP % + (1 - e* N ) P ' N ) 

where p* k ^ p' k , p* k ^ p' k \ and < 6% < 1. 

Here we put by using 8 k , < k <l, k = 1, • • • ,N, 

K.(6i, ■ ■ ■ , 9n) = 

I{{6 lP '{ + (1 - 6M x ••• x {6 N p'± + (1 - 9 N )p' N )) 

and investigate the Kuhn-Tucker conditions and the boundary 
equations with respect to this K(9%, ■ ■ ■ , #at). The Kuhn- 
Tucker conditions are simple to see as 



/C fe (0i,. 



)=0, k = l,---,N 



(11) 



where K k (6i, ■ ■ ■ , 9 N ) = dfC(9i, ■ ■ ■ , 9 N )/89 k . Also by a 
decomposition 

JC(9\, ■ ■ • , 9n) — 

IC(9 1 \9 2 ,---,9 N )+IC(92\9 3 ,---,9 N /9 1 ) 
+IC(9 3 \9 4 ---,9 N /9 1 ,9 2 ) + --- 
+K,(9n/9 1 , • ■ • , 6*jv_i) 
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Rn 




gradient > — 1 
gradient < — 1 



boundary 



Ri 

Fig. 2. Boundary of cross-section Gi(Rl, Rn) in Ri-Rn plain. Rates 
R2, ■ ■ ■ 1 Rn—1 ws fixed as specified by (14) . 



we obtain a set of achievable rates 

Q X = |J (/C(^! |^ 2 , - • - , 6»jv), - " • , /C(^iv/01, • • • , ^7V-l)) 



(12) 



which leads us to the boundary equation for Gi as follows: 

£i(f?i|02, ■ • ■ ;0jv) ^x\P\i ■ • ■ j 9n) 



det 



/Cjv(#i|#2, ■ • • , On) ICn{0i, ■ ■ ■ , On) 



}Ci(o 2 \9 3 ,---,8 N /9 1 ) 



K 



N\P2\V-i, ' ■ 



, 9n/9i 



^Ci(0jv-i|0jv/0i, • • ■ , &N-2) 



£/v(0jv-i|0/v/0i, • • • , On-2) 



= 



(13) 



where K k {- ■ ■) = dlC(- ■ ■) / dO k . 

Since p* satisfies (II Oi l. (0*, • • • , 0^-) is a solution of the 
Kuhn-Tucker conditions (fTTb . Then by Proposition[2]it satisfies 
the boundary equation ((T3) and Mr = /C(0f , • • • , 8* N ). 

Now we examine a gradient of the boundary of Gi at 9* = 
(0*, ■ ■■ , 9 N ). Note that the solution 8 = (6%, ■ ■ ■ , 9 N ) of the 
boundary equation ( fT3l around 9* defines a set of achievable 
rates <Q21i as Gi(Ri,---,Rn)- Obviously /C(0*) = M T . At 
this step we investigate a cross-section of (fT2l subject to the 
restrictions such that 



/C(0 2 |03,---,Wi) = WW: 



3' " ' 



The cross-section Gi(Ri,Rn) is a region in the two- 
dimensional (Ri-Rn) plain as shown in Fig. [2] Since it holds 



JC 1 (9 2 \9 3 ,---,9 N /9 1 ) = 



'7Y-1 t/jv 



■ , on-2) 







by the restrictions (1141 1. then we have /Ci(0i, • • • , 0j\r) = 
/Ci(0i|0 2 , • • • ,0/v-i) + Kx{e N /6x, ■ ■ -,9 N -i). Thus the gra- 
dient of the boundary of Gi(Ri, Rn) appears 



K-(9n-i\9n/9i, ■ ■ ■ , 9n- 2 ) — K.(0 N _ 1 \0 N /0l, - ■ • ,0 N _ 2 ). 

(14) 

We denote a cross-section (subset) of Gi subject to (fl4] i as 
Gi(Ri, Rn)- This is composed of 

I2(0i, • • • , 9n) = 

(K(0 1 \0 2 ,---,0 N ),)C(0* 2 \0* 3 ,---,0 N /0* 1 ) r --, 
1C(9 N _ 1 \9 N _ 1 /91, • • • , 9* N _ 2 ), JC(9 N /9i, • • • , 9 N -i))- 



K,\(9n /0i, • • ■ ,0jv-i) 



-1 



/C x ( 



/Ci(0i|02, • ■ • , 0jv) A^i(0i|02, • ■ • , 0jv) 

The right-hand side of ( fT3T > is estimated as 

1 , A(0ir 



/Ci(0i|0 



1 C2, • • ■ 



^n) 
,0n) 



<(>)! 



(15) 



(16) 



according to the maximization (minimization) conditions of 
/C(0i|0 2) • • • , Off) subject to (O where it holds 



/C 1 (0 1 ,---,0 iv )/C 1 (0 1 |0 2 



7jV 



) < (>) 0. 



Also the gradient of the boundaries of any cross-section 
Gi{Ri,Rk) (2 < k < N- 1) is given by (O. 

For any region Gi of AM decompositions, the gradient of the 
boundary of Gi at 9* takes the same condition as that of Gi- 

Since the inequalities ( fTo*b are valid for any p' k , p' fe ', k = 
1, • • • , N, there exists a neighborhood U p * of p* in A, such 
that I(p*) > /(p G C/ p «). This means that p* is local 
maximum in X. 

In the second case, since at least one of p£(ifc)'s is zero, 
p* satisfies the Kuhn-Tucker conditions: 



= M Tl tfc G A(F fe ) 
< M T , i* A(Ffc) 
fc = N, M T = I(pl x---xp* N ) 



J(Pi x ■■■ xp* N ;i k ) 



(17) 



where p k (i k ) > for i k e A(F fe ) and p£(ifc) = for ^ 
A(Ffe). Thus there exists a sub-domain F = F\ x • • • x Fn 
such that p* G F. This implies that p* is local maximum in F 
as described in the first case and there exists a neighborhood 
U 0p , C F such that /(p*) > I(p e U 0p *). 

For any p' = p^ x • • • x p' k x • • • x p' w 6 C/o P *, consider 

p" = Pi x ' ' ' x P k x ' ' ' x Pn' wnere Pfc e -^fe and pj.' ^ 
F k . Put for < 9 < 1 



A(0) = /(pi x ••• x (0p£ + (1 - 0)p' fc 



Pn)- 



It holds dK(9)/d9 \ 8=0 < 0, since AT(0) is concave, differ- 
entiate, and p* satisfies i 171 . Therefore A(0) is monotone 
non-increasing for 9. Thus there exists 9' > such that 
/(pi x ... x {6'p'l + (1 - 0')pL) x • • • x p' N ) < I(p*). 
Hence, there exists a neighborhood U p - C X of p* such that 
^(p*) ^ ^(P G i7 P »). This means that p* is local maximum 
in X. 

By these two cases Proposition [3] is proved. ■ 



g 



1 





p J 


p 









O 1 

01 

Fig. 3. Pattern of D(a ) = Di U D 2 for the case of N = 2, m = ni = 2, 
pi(0) =6»i,p 2 (0) =0 2 . 

Connectedness 

Finally in this section, we prove the property of connected- 
ness for the elementary MAC as a proposition: 

Proposition 4: If an TV-user (m, • • ■ , n^v; m)-MAC (P, X) 
is elementary, i.e. n k < m, k = 1, • • • , N, then the set 

D(a) = {p\I(p G X)>a} (18) 

is connected for any a > 0. □ 
Proof: Assume that for any e > 0, there exists ao > 
such that .D(ao) is connected and D(ao + e) is disconnected. 

Since I(p) is concave on each Xk, then there exist subsets 
D\ and D 2 of -D(arj) with properties as follows: 

1) D(ao) = D x U D 2 , and J(p*) = o Q , for p'eDjfl D 2 . 

2) For any p^ x • • • x p' k x • • • x p' N G D\, all IPD vectors 
p[ x • • • x p k x • • • x p' N , p k G X k , k = 1, • • • , N, 
satisfying I(p[ X • • • X p k X • • • X p^) > ao belongs to 
Di, and also for any p" x • • • x p' k ' x • • • x p'^ € P 2 , 
all IPD vectors p" x • ■ ■ x p k x • ■ ■ x p^, p fc e X k , 
k = 1, • • -,N, satisfying I(p'{x- ■ -xp k x- ■ -xp^) > a 
belongs to £>2 (cf. Fig. [3). 

Thus for any e > 0, P(arj +e) is separated into subsets C 
D 1 and £> 2 C D 2 such that Z?(a) = D[UD' 2 and D' 1 nL> 2 = </>. 

It is easy to see that for any p* = p| x • • • x p* k x ■ ■ ■ x p* N £ 
Dx n D 2 , k = 1, ••• N, it holds 

*(P* x ' • • x Pk x ' ' ' x P*n) < «o, Pfc e X fe (19) 

since for any p = p x x ■ • -xp N €Di (or p G D2), p ^ Di<lD2, 
every p x x • • • x p k x • • • x p N , k — 1, • • • , N, satisfying 

I(Pi x ■ ■ ■ x P k x ' ■ ' x Pn) < a o, Pk e X k 

belongs to neither D\ nor D 2 by the property 2) (see Fig. |3J- 
Consider two cases: Every components of p* is non-zero 

and at least a component of p* is zero. 

In the first case, it holds by ( fT9] l that p* eflifl D 2 satisfies 

the Kuhn-Tucker conditions 

J(p\ x ■■■ xp* N ;i k ) = a , p* k (i k ) 7^0 

i k = 0, • • • , nk - 1 
fc = l,---,JV. 

Therefore p* is local maximum for p 6 I by Proposition [3] 
since (m, • ■ • , njv; m)-MAC (P, X) is elementary. Then there 



exists a neighborhood U p * of p* in X such that I(p) < ao 
for any p G (7 P * . 

On the other hand, by the properties of D\ and D 2 there 
exists p' in either U p - HDi or (7 P » (~ll?2 such that I(p') > ao- 
This is inconsistent with that p* is local maximum. Therefore 
D(a) is connected. 

For the second case, consider the minimum domain F = 
F% x • • • X Fn C X which contains the p* exactly inside (and 
not on the boundary of) F k , where Pk{ik) = for i k $ A(Ffc) 
and Pk{ik) > for i k G A(F k ), k — 1, ■ • • , N. In the same 
way as in the first case, it is proved that D(a) {~)F is connected. 
Therefore D{a) is connected. ■ 

V. Binary-inputs MAC 

In this section, we investigate an Abuser binary-inputs MAC 
(P, Y) of the A-user (m, • • • , n N ; m)-MAC (P, X) where 
each Yfc of Y is formed by a line segment. For any given 
p' k , p k G X k , k = 1, • • • , N, define a line segment Y k by 

Y k = {9 k p'k + (1 - 0k)Pk\O <6 k <l}, k = 1, ■ • • , N 

and denote Y = Yi X • • • X Yjy. Reasonably we set f? = 
(f?i, • • • , #jv) and write 8 k G Yfc, 9 £ Y. Thus we can build 
up an A-user binary-inputs (2, • • • , 2; m)-MAC (P, Y) whose 
channel matrix is P and domain is a subset Y of X. Obviously 
it is an elementary MAC since m > 2. 

The mutual information of the A-user (2, • ■ ■ , 2; to)-MAC 
(P, Y) is given by 

• • • , 0jv; p', p") = + (1 - 0iK)x 

• • • x (^jvp'jv + (1 - (20) 

where < 8 k < 1, k = 1, • • ■ , A, and p' = p[ x ■ ■ ■ x p' N , 
p" = p'l x ■ ■ ■ x p" N . It depends on the choice of p' , p" . The 
Kuhn-Tucker conditions for (f20b are given by 

X k {9 1 ,---,e N ;p',p") = 0, fc >O 

< 0, e k = o 

k = l,---,N (21) 

where I k (- ■ ■ ; p', p") = (9Z(- • • ; p' , p")/d8 k . For simplicity 
we omit p' , p" from the expression and denote 1(9; p' , p") = 
1(9), in the subsequent discussions. 

We prove the lemma to be used for the proof of Theorem |2] 
as follows: 

Lemma 1: The Kuhn-Tucker conditions for the A-user bi- 
nary (2, • ■ • , 2; m)-MAC (P, Y) as defined above are neces- 
sary and sufficient for optimality. □ 
Proof: It is sufficient to prove the sufficiency. Assume 
that there exist two solutions 9 = (81, ■ ■ ■ ,9n) and 9 = 
(81 , ■ ■ ■ , 8n ) of the Kuhn-Tucker conditions d2lT> such that 
2(9) ^ 1(9). Without loss of generality, assume that 1(9) > 
1(9). 

Since the A-user binary (2, • ■ • , 2; m)-MAC (P, Y) is ele- 
mentary, by Proposition [3] the solution 9 is local maximum 
in Y" and there exists a neighborhood [/s of fl such that 
1(9) > 1(9 G Ug). Also by Proposition @] the set D(l(9)) = 
{9\1(9)>1(9),9 G Y} is connected and includes both 9 
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Fig. 4. Two solutions of the Kuhn-Tucker conditions for two-user case. 



Theorem \2\ The Kuhn-Tucker conditions for the channel 
capacity C of an A-user elementary (n\, ■ ■ ■ , n^', m)-MAC 
(P, A), where n k < m for all k = 1, • • • , TV, are necessary 
and sufficient. □ 
Proof: It is sufficient to prove the sufficiency. Let p = 
p 1 x • ■ ■ x p N a solution of the Kuhn-Tucker conditions 
© for the TV-user elementary (ni, ■ ■ ■ ,n N ; m)-MAC (P, A), 
where n k < m, k = 1, • • • , TV. We prove that p is uniquely 
determined in the sense that any solution p of the Kuhn-Tucker 
conditions (O gives the same for I(p). 

For an arbitrary p' k G X)., k — 1, ■ • • , N, there exist p' k ' G 
A& and such that 

Pk = hp'k + (1 - h)Pk, 0<f? fc <l (22) 



and 0. Then for any G D(l(9)) n t/g, it is easy to see 
1(0) =1(9). 

Let 0* and 0* be any points in D(1(0)) n L/g, and set 
J(f?J, • • • , (a6»* + (1 - a)0£), • • • , 0Jf) as a function of the 
variable a. Since 1(9) is concave for each variable 9 k and 
X(0*) = l(9 f ) = 1(0), we have 1(9\ , • • • , (a0* k + (1 - 
• • • > 0jvO = for < a < 1. Therefore, it holds 
dJ(^- ■■>£?* + (l-a)c?t ),..., fl^) _ 
da 

(^-^)I fe (^,...,(a^ + (l- a )4),...,^) 
= 0. 

This implies that any G D(T(0)) n l/ e satisfies the Kuhn- 
Tucker conditions ( ETT i: 2fe(f?i, • • • , f?fe, • • • , f?jv) = 0, fc = 
1, • • ■ , 2V, even if is located on the boundary of Y. 
Let A(f)) be a set 

A(0) = {0\I k (0) =0, fc = l,...,JV, 
1(0) =1(0), 0eD(I(0))}. 

Clearly, this includes D(1(0)) n (7^ and it holds 1(0) = 1(0) 
for G A(0) (see Fig 0J. Note that each point in A(0) 
is local maximum. Then for any 0' G A(0), there exists a 
neighborhood CV, such that T(0) < I(0')(= 2T(0)) for any 

Here we define a subset of Ue> as V = {0\0 G Ue>,0 £ 
A(0)}nD(J(0)). Assume that 7 is non-empty. Then it holds 
T(0J < 1(0) for any 9 G V, since G {0|0 G f7 e /,0 g 
A(0)}. On the other hand, it holds that 1(0) > 1(0) for any 
G V since G D(1(0)) by the definition of V. This is 
inconsistent with the assumption that V is non-empty. Thus 
V is empty and A(0)_= D(l(9)). 

Since both and belong to D_(l(9)), it holds T(0) = 
1(9). Therefore the assumption 1(9) > 1(9) is invalid. This 
means that any solution of the Kuhn-Tucker conditions (fJTJ 
for (P, Y) gives the same value for X(0)and then it is optimal. 
Thus the sufficiency is proved. ■ 

Note that the Lemma[T]holds for any domain Y of X formed 
by p' and p" . 

VI. Proof of Theorem[2] 

In this section, we prove Theorem |2] by using Lemma [T] 
We state again Theorem |2 



since X k is simplex. Then p is represented by 

p=(9 1 p' 1 + (l-9 1 )p1)x 

• • ■ x (6 N p' N + (1 - 6 N )p%). (23) 

Here we define a function of variables (f?i, • • • , On) = 9 
(0 < 9 k < 1) by 

l(9;p',p")=I((9 1 p' 1 + (l-9 1 )p'{)x 

■ • • x (9 NP ' N + (1 - 9 N )p N )) (24) 

where p' = p[ x • • • x p' N and p" = p'[ X • • • X p" N . The 
function d24] > can be regarded as the mutual information of 
an AT-user (2, • • • , 2; m)-MAC (P, Y) with the domain Y = 
Yx x • • • x Y N , where Y k = {9 k p' k + (1 - 9 k )p'l\0 < k < 
1}, k = 1, • • • , A. The AT-user (2, • • • , 2; m)-MAC (P, F) is 
denoted by (P,Y)/ p , p i,\, since it depends on p',p". 

Since p is a solution of the Kuhn-Tucker conditions © for 
(P, A), then is a solution of the Kuhn-Tucker conditions for 
the mutual information d24T i of (P, Y)r p ^ p iry. 

l k (9;p',p") = C, 9 k >0 
< C, 9 k = 

k = l,---,N, C=l(9;p',p") (25) 

where l k (9;p',p") = dl(9;p' ,p")/d9 k . Therefore, it fol- 
lows from Lemma[T|that is optimal for (P, Y)(p',p")> which 
means 

l(9;p',p")>l(9;p',p") (26) 

for any G Y. 

Since is given by ( f23l , it holds 

l(9;p',p") = I(p) (27) 

for any p' 6 A, where p" satisfies ( f22l . Thus since (|26l l and 
(|27l i are valid for any p' G A, it holds 

m > Hp) 

on the whole domain A. This implies that p is optimal. 
Thus we proved the theorem. ■ 
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VII. Conclusions 

After Shannon [2] multiuser channel has long been studied 
in various fields. However not much works have been made 
for the fundamental property of the channel capacity of an Ab- 
user (ni, • • • , njvO-MAC (P,X) in general except for some 
specific cases. 

We have shown that there exists a non-trivial MAC where 
the Kuhn-Tucker conditions are necessary and sufficient for 
the channel capacity. We called it as an elementary MAC that 
was defined by the MAC whose sizes of input alphabets must 
be not greater than the size of output alphabet. Obviously the 
A-user binary inputs (2, • • • , 2; m)-MAC (P, X) is a typical 
example of the elementary MAC. Also the DMC is a trivial 
elementary MAC. 

We believe that there is considerable merit in a concept of 
elementary MAC for which the channel capacity is evaluated 
precisely by the necessary and sufficient condition as in the 
case of DMC. In fact, we have proved as Theorem Q] that 
the channel capacity of any MAC is achieved by the channel 
capacity of an elementary MAC contained in the original 
MAC. Thus an MAC in general can be regarded as simply 
an aggregate of elementary MAC's. This statement is a basic 
idea behind our formulation of this paper. 

The most of this paper was devoted to the proof of The- 
orem |2] such that the Kuhn-Tucker conditions are sufficient 
(the necessity is self-evident) for the channel capacity of the 
elementary MAC. We have shown as Proposition |2] that a 
solution of the Kuhn-Tucker conditions if it satisfies the equal- 
ity portion of the conditions satisfies the boundary equations 
which define the boundary of the capacity region. Then we 
could prove the property of local maximum as Proposition [3] 
followed by the property of connectedness as Proposition |4] 
By using these two distinctive features we could prove that 
any solution of the Kuhn-Tucker conditions of the elementary 
MAC was uniquely determined, that is, each solution takes 
the same value for the the mutual information and therefore 
it achieves the channel capacity. 

In this respect, we remark that the non-elementary MAC has 
a degenerate property as explained in Section UD If it exists, 
then it is difficult to identify which IPD vectors are exactly 
contributed to the mutual information of the MAC. However 
we overcome these difficulties by introducing the concept 
of elementary MAC where there exists no such degenerate 
property. Since the well-known DMC is elementary, then the 
elementary MAC is identified as an extension of the DMC. 

Incidentally, our notation introduced in this paper seems 
rather non-standard including expressions of IPD vector p, 
Kronecker products p = p x x • • • x p N , the channel matrix 
P regarded as a non-linear mapping, domain X, face F, and 
so force. However we emphasize that the notation appears 
effective to resolve the cumbersome procedures relating to the 
extremum evaluation of the multi-variable mutual information 
with constraints for the MAC. 

Before closing we remark that the very essence of infor- 
mation theory consists in two major subjects such as source 
coding and channel coding as we know. This paper seems to be 
quite effective in working out the subject of channel coding 



since we provide for a formalism to determine the channel 
capacity of the MAC. We are confident that two distinctive 
features of local maximum (Proposition [3]l and connectedness 
(Proposition |4|i represent an intrinsic structure of the MAC. 
However we are not content ourselves with this stage. We 
are expecting that our results will be a mathematical base for 
various subjects of the MAC including the numerical and/or 
exact evaluation of the capacity region, the analysis of the 
MAC with feedback as well as the structured approach to the 
multiuser coding, and so force. 
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